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Abstract 

Simulation results of Ising systems for several update rules, observables, 
and dimensions are analyzed. The lattice-size dependence is discussed for the 
autocorrelation times and for the weights of eigenvalues, giving fit results in 
the case of power laws. Implications of spectral properties are pointed out 
and the behavior of a particular observable not governed by detailed balance 
is explained. 
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I. Introduction 



The reduction of critical slowing down in Monte Carlo simulations achieved 
by cluster algorithms [U has provided access to particularly interesting regions of 
physics. So far, however, efficient algorithms of this type are only known for lim- 
ited classes of systems. For example, extensions are particularly desirable to gauge 
fields. There are treatments @ of the discrete case of Z 2 gauge theory in 3 di- 
mensions where one has duality to the Ising model. However, for continuous gauge 
theories only for the very special situation of one time step in SU (2)-theory at finite 
temperature a successful algorithm using an Ising embedding has been obtained 0. 

A prerequisite for any further developments of cluster algorithms is a better un- 
derstanding of the details which are responsible for specific properties. To make 
progress within this respect recently f§] the effects of flipping rules have been stud- 
ied. In the present paper more details of the simulation results are presented and 
analyzed. In addition theoretical discussions and explanations of some observations 
are given. 

Sec. II contains an overview of the simulations of Ising systems and of the auto- 
correlation fits. It also presents ratios of main modes, quantitative results about 
fast modes and details of the dependence of the cluster-size observable on lattice 
size. In Sec. III. the lattice-size dependences of the autocorrelation times and of the 
weights of eigenvalues are given and discussed. The analysis is based on power law 
fits wherever this is possible. In other cases, where also logarithmic fits do not work, 
the considerations rely on figures. 

Effects of spectral properties are discussed in Sec. IV. It is pointed out that the 
results for the spin-dependent observables conform with the theoretical expectations. 
The peculiar behavior of a particular observable, describing the sum of sizes of the 
clusters with flipped spin, is explained in Sec. V. It provides an example of a situation 
where there is no detailed balance and also of the ways to deal with more general 
transition probabilities. 
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II. Monte Carlo simulations and results 



The Ising systems have been studied at the infinite-volume critical point on 
hypercubic lattices with periodic boundary conditions in 2, 3, and 4 dimensions. 
The /3-values used are log(l + y/2)/2 , 0.221650 §, and 0.149663 §, respectively. 
The observables measured in all cases are the energy E, the magnetization M , 
the susceptibility x > an d C, the relative size of the clusters the spins of which are 
flipped ( i.e. the number of flipped spins divided by the number of sites). For each 
of the observables also the autocorrelations have been determined. Relatively high 
statistics has been collected (with 2 x 10 6 to 10 7 sweeps for lattice sizes up to 64 2 , 
16 3 , and 9 4 , and up to 5 x 10 5 sweeps for some larger lattices) in order to make the 
fits to the autocorrelation functions possible. 

In addition to flip probabilities according to Swendsen and Wang U (SW) and 
to Wolff [0 (WO), and of flipping the largest cluster (LC), a prescription || 
(SC) has been investigated which requires to flip the largest cluster and those not 
in contact with it. Contact between two clusters means that there is at least one 
site belonging to the first cluster which is only one lattice spacing away from a site 
belonging to the second one. 

The occurring time scales and the fit procedure for the autocorrelation functions 
have already been discussed in detail in ||. With respect to the main modes of 
the transition spectrum it turned out that SC and SW are described by functions 
of form ce~ l l T and LC and WO by functions of form ce~ l ^ T + C2e~ t ^ T2 (representing 
terms in the normalized autocorrelation functions). In addition to the values of r, 
c, T2, and C2 also the integrated autocorrelation times rf nt , T* nt) r^f t , and rf nt have 
been determined. 

Presenting more details it is to be noted that the ratios r/r 2 in d = 2, 3, and 4, 
respectively, have the values 3.2(4), 1.9(2), and 1.8(2) for LC and 2.7(2), 2.3(2), and 
2.5(2) for WO. These numbers in d = 3 and 4 apply to the whole range considered 
while in d = 2 the numbers at L = 32 are given. This is related to the fact that in 
d = 2 the lattice-size dependence is not a power law as will be discussed in Sec. III. 
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In addition to the main modes included in the fits, fast modes only noticeable 
in the vicinity of t = occur. In the following to give quantitative results on their 
magnitudes the overall coefficients c/ = 1—77(0) are used where rj(t) is the fit function 
determined at larger t and having one of the forms mentioned above. 

In general the Cf slightly increase with lattice size and dimension. In the case of 
SW the Cf are in the range of about 0.03 to 0.07 for E, of about 0.05 to 0.2 for x, 
and of about 0.1 to 0.3 for M. For the decay time of a fast mode a typical number 
(obtained from a 4-parameter fit for d = 4 and L = 8) is 0.7(2) as compared to 
4.79(3) of the leading mode. Estimates in other cases give similar results. For C 
only a fast mode concentrated at t = is observed within errors (with an upper 
limit of 10 -3 for other contributions), i.e. p(t) = 5 t fl is found. In the case of WO 
the behavior of fast modes is qualitatively the same as for SW for E, x, and M. For 
C again a strong mode proportional to 5 tt o occurs, however, also the main modes 
still contribute. 

In the case of SC fast modes show rather different behaviors for different observ- 
ables. For E there are no or almost no fast modes within errors. For M the overall 
coefficients c/ are in the range of about 0.2 to 0.3 and one observes oscillations, i.e. 
contributions with a time dependence of the form (— l) t e~ t / Tl/ . For \ the c/ are in 
the range of about 0.1 to 0.2 and decaying as well as oscillating contributions occur. 
For C in d = 2 the coefficients Cf are rather accurately known (being 1 — c with the 
fit result for c in Table 2). With lattice size they increase strongly from negative to 
positive values. The time dependences observed change from oscillations at small 
lattices to a purely decaying behavior at larger lattices. For LC the observed fast 
modes are very similar to those seen for SC. 

For LC and WO the measured values of (C) decrease with L according to power 
laws. Results from fits to kL z for these cases are given in Table 1. For SW one has, 
of course, (C) = \. For SC after decreasing with L a minimum is reached which 
occurs earlier in higher dimension. This behavior reflects the fact that the sum of 
the relative sizes of the clusters not in contact with the largest one increases. To 
describe the situation within this respect in detail in Fig. 1 (C) lc and the difference 
(C)sc — (C)lc denoted by DC are shown. The fast increase of DC at larger L in 
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higher dimension makes clear that one should account for connectivity (as discussed 
in [|J) also among clusters not in contact with the largest one. 

III. Lattice size dependences 

For the quantities r, c, r 2 , C2, r^ t , rf nt , r^ t , and rf nt obtained in the fits to 
the autocorrelation functions next the dependence on the lattice size L is to be 
considered. Fits to the law kL z have been performed for all of those quantities 
whenever this has been possible within errors. Results of these fits are given in 
Tables 2 and 3 (omitting some less interesting or less accurate cases). 

In these power-law fits again interval stability and magnitudes of x 2 -values have 
been checked. Throughout this has led to exclude L = 4 (though graphically the 
deviations mostly appeared small). Systematic errors have been estimated in partic- 
ular from residual interval instabilities. They are smaller than the statistical errors 
in the one-mode cases and of the same order in the two-mode cases. While in the 
few examples of power-law fit data already given in Q the errors are only statistical 
ones, here the estimated systematic errors have been combined with the statistical 
ones to obtain the errors presented in the tables. Further, some of the numbers have 
been conservatively rounded to allow an easier overview. 

The autocorrelation times in d = 3 and 4 within errors are consistent with power 
laws. For d = 2 in general different dependences on the lattice size L are found for 
all flipping rules. In such cases the symbol fl is entered in Tables 2 and 3 if they are 
listed at all. For SC and SW in d = 2 logarithmic fits for x an d M, represented as 
power law fits of exp(rj n t) in Table 2, are possible while they can be ruled out for E 
and are also not possible in other cases. 

Due to the accuracy of the data it is to expected that the different behaviors of the 
autocorrelation times in d = 2 will persist at higher L. On the other hand, usually 
one expects only powers and logarithms at sufficiently large L. How this is to be 
reconciled with the numerical results is at present an open question. Thus data on 
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various autocorrelation times for SC, LC, and WO which could not be described by 
fits are presented in Figs. 2, 3, and 4. 

The results on the lattice-size dependences of the weights of the eigenvalues are 
given by the numbers for the coefficients in Tables 2 and 3 and in Figs. 5-7. It is 
seen that depending on dimension and particular observable decreasing, constancy, 
or increasing is observed. The changes of the coefficients with L in general are not 
large such that some effort has been necessary to get them. Generally the change 
is slightly stronger for M than for x while for E it is small. For C the behavior is 
frequently rather different from that found for the other observables. 

For SC the fits show (Table 2) that with increasing d negative slopes turn into 
positive ones. For SW generally decreasing behaviors occur, with power laws (Table 
2) and with deviations from this in d = 2 (Fig. 5). For LC and WO at least in d = 3 
and 4 (and apart from the observable C) the general tendency is that c increases 
and that C2 decreases as is indicated to some extend in the examples of Figs. 6 and 
7. The sum c + C2, on the other hand, remains essentially constant (Table 3). 

For the coefficients deviations from a power law may be caused by the self- 
adjointness of the transition matrix, which implies that c cannot become larger 
than 1 as will be pointed out in Sec. IV. Deviations of this type are shown in Fig. 5 
for the example of SW in d — 2. On the other hand, if there is no such restriction 
c-values larger than 1 occur. That they do is seen in the example of SC for C in 
d=2, the power-law data of which are given in Table 2 and the mechanism for which 
is explained in Sec. V. 

It is to be noted that (at least at the values of L which can be reached in practice) 
simultaneous power-law behaviors of r int , t u , and c u cannot be expected in general. 
The reason for this is that a term c u e~ t l Tv from p(t) gives the contribution c u (e 1 ^ Tl ' — 
to Ti n t — \ + J2t>iP(t). Only if the decay time of the leading mode is large 
and its coefficient is not small, such that the approximation r int ct holds, the 
laws k c L Zc and k T L Zr combine to the simultaneous law k c k T L Zc+ZT . The data in 
Tables 2 and 3 are in agreement with these considerations. Empirically there is 
some indication that primarily one has power behavior of r and of c while for Ti nt 
one relies on the decribed approximation. 
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IV. Effects of spectral properties 



The spectral properties of the transition matrix W(a; a') manifest themselves in 
the autocorrelation function 

R(t) = (f s f s+t ) - (f s ) 2 (4.1) 
where with the probability distribution /i(cr) and an observable f(a) one has 

</*> = £/*(*)/(*) (4-2) 
W 

and 

(ftft + i}= £ ^)f(v)W(a,a')f(a') . (4.3) 
WhW'} 

To discuss these spectral properties a Hilbert space with an inner product defined 
by 

(f,g) = J2^)r(a)g(a) (4.4) 
M 

is convenient |J. In the indicated metric detailed balance is just the condition for 
self-adjointness. 

Using the spectral representation Yjv ^»F U of the transition operator with projec- 
tors F v , eigenvalues A„ , and Ai = 1 , one gets 

R(t) = J2K(f,FJ) . (4.5) 

From stationarity and ergodicity it follows that apart from the eigenvalue 1 all 
eigenvalues of the transition matrix are in the interior of the unit circle. If detailed 
balance holds the self-adjointness of the transition operator implies real eigenvalues 
and positive weights. Then the parametrizations \ u = e~ x l T and = — e -1 / T are 
appropriate which give the time dependences e _<//r and e~*/ T (— 1)*, respectively. 

The spectral representation of the normalized autocorrelation function pit) = 
R(t)/R(0) has the form 

p(t) = Y,Kcu ■ (4.6) 
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From this and p(0) = 1 one gets the condition J2 V °v = 1 f°r the coefficients. Thus, 
if detailed balance holds, in which case all c v must be positive, they also cannot 
exceed 1 . Numerical results illustrating this have been discussed in Sec. III. 

In cluster algorithms the conditioned probability A(a; n) for getting the bond 
configuration {n} if the spin configuration {a} is given is important. The joint 
probability distribution fij(n, a), the occurrence of which in the case of the SW rule 
has been pointed out in can be generally expressed by [ij(n, a) = fi(a)A(a, n). 
For the SW flipping rule, where the new cluster spins are choosen independently of 
the old ones, the conditioned probability to get the new configuration {a'} if the 
configuration {n} is given may be written as 

A(n;a) = fij(n,<r) l^2tij(n,a)\ (4.7) 

Vw / 

and the transition matrix gets the special form 

Wtoo') = ^A{<T',n)A{n-,o') . (4.8) 
W 

For (|4.8|) detailed balance follows straightforwardly from the definitions (provided 
that A has the appropriate properties, which is guaranteed by the usual construc- 
tion). Further from (f,Wf) = (Vjf,Vjf) with Vj(n,a,n',a') = A(n; a')6(n,n') it 
is seen that the transition matrix is positive in this case. This conforms with the 
observations of a real positive spectum in the simulations for SW. 

For the other flipping rules considered the more general transition probability 

W(a;a') = £ A(<r; tr; </) (4.9) 

M 

applies, where B is the conditioned probability to arrive at {a'} if both {a} and {n} 
are given. The choice of B is important for the spectral properties. Now (in addition 
to the appropriate properties of A) B must be symmetric in a and o' in order 



that (O) satisfies detailed balance. For the other rules considered detailed balance 
follows readily on the indicated basis. Thus the spectrum is again real, however, no 
longer necessarily positive. In fact, for SC and LC oscillating contributions related 
to negative eigenvalues are observed. 
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Because the factor y/2r int enters the statistical error and the integrated autocore- 
lation time is related to p by 



2r int = 1 + 2J2 Pit) 



(4.10) 



in view of (|4.6|) it should be obvious that not a positive spectum as in the SW case 
but rather a negative one is optimal. If this could be realized a drastic reduction of 
the errors by anticorrelations would be obtained. 

The general law has been found Q that the leading eigenvalue of the transition 
matrix tends to dominate if the pattern of clusters subject to spin flips becomes 
extended. The indicated relation between flipping pattern and spectral distribution 
is reminiscent of familiar relations for conjugate variables in Fourier transforms. 
The reason for this is that the spectral represention of the transition matrix relates 
changes of configurations to the spectrum in an analogous way. This explains the 
observation. 

The discussion of spectral properties on the basis of the scalar product ([4.4] ) for 
observables of type f(a) applies to E, x, an d M. For the quantity C more general 
considerations are necessary which will be outlined in Sec. V. 

V. Joint probabilities and spectra 

Because configurations {a} as well as configurations {n} are generated, in addition 
to observables depending on a one may also measure more general ones depending on 
a and n. One then could consider transitions with respect to the joint distribution 
fj,j(a,n). However, in the case of the observable C defined in Sec. II one has to 
go still farther. One has to realize that B contains two steps, the selection of the 
clusters in which the values of the variables are to be changed and the actual change 
of the values. This is described by the decomposition 




(5.1) 
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where {z} denotes the partitions of the clusters in two sets, the set in which the 
spins are flipped and the one in which they are kept. 



In this way one arrives at observables with the general dependences f(n, z, a) and 
a more general joint distribution fic(n,z,a) = fi(a)A(a;n)F(n, z). The transition 
probability then becomes 

W c {n, z, a, n\ z', a') = G(n, z, a, a')A{a'\ n')F(n, z) . (5.2) 

The conditions providing detailed balance for W (er; a') and fi(a) now only lead to 
the stationarity relation 

Y Hc(n,z,a)W c (n,z,a,n',z',a') = fi c (ri , J , a') , (5.3) 

{n},{z},{cr} 

however, in general not to detailed balance in the generalized scheme. 
Instead of (|4.2p and (|4.3[) one now has to deal with 



(ft) = Vc(n,z,a)f(n,z,a) (5.4) 



and 



(ftft+i) = Vc(n, z, a)f(n, z, a)W c (n, z, a, n', z\ a')f(n', z', a') 

{n},{z},{*},{n>},{z'},{*>} 

(5.5) 

and to discuss spectral properties on the basis of the more general scalar product 
(f,g)z= Vc(n,z,a)f*(n,z,a)g(n,z,a) . (5.6) 

{n},{z},{*} 

In the special case where f(n,z,a) = f(a) from (|5.4j) and ( |5T5|) one gets back to 
(|4.2| ) and (|4~3|) , respectively. If f(n,z,a) = f(n,z), as holds for the observable C, 
one obtains (f t ) = £{«}{*} p>c(n, z)f(n, z) with fi c {n,z) = fl(n)F(n,z) for flglp , 
however, for (|5.5|) in general no simplification occurs. 



Thus one is confronted with the situation where there is no detailed balance but 
only stationarity and where the transition operator is not self-adjoint. The projec- 
tions in the spectral representation then are described by a biorthogonal system and 
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need not to be self-adjoint. Then the weights of the eigenvalues must no longer be 
positive. This explains the occurrence of negative contributions for the observable 
C which have been identified in the simulations and determined with some precision 
for SC in d = 2. 

In the case of complex eigenvalues one has to note that they come in conjugate 
complex pairs because the transition matrix is real. For such a pair, being associated 
to a pair of complex conjugate projection matrices, the contribution to ( |4.5|) is of the 
form cA* + c*\* t . Parametrizing by A = e _1//T e^ and c = |c|e 4 ^, the time dependence 

e~ t/T cos(<f)t + ip) (5.7) 

is obtained. The oscillating behaviors which in the case of the observable C for SC 
in d — 2 are seen on smaller lattices are consistent with the form which one gets if 
and if; are not too far from 7T. Such types of behaviors are generally noticed for SC 
and LC, though with superimposed decaying modes and with larger errors in other 
cases. 
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Figure Captions 

FIG. 1. (C) LC and the difference (C) sc ~ (C)lc denoted by DC 

in d — 2, 3, and 4 dimensions as functions of L. 

FIG. 2. r, r^ t , rg t , rf nt , and for SC in d = 2 as functions of L. 

FIG. 3. rg t , rg t , r? nt , and r^ t for LC in d = 2 as functions of L. 

FIG. 4. r, r 2 , and rf n t , rg v T* nt , r^ t for WO in d = 2 as functions of L. 

FIG. 5. c E , c x , and c M for SW in d = 2 as functions of L. 

FIG. 6. c £ , c x , and cf , c 2 for LC in d = 4 as functions of L. 

FIG. 7. c £ , c x , and cf , c x for WO in <i = 3 as functions of L. 



TABLE 1 



Fit to kL z for (C). 





LC 


WO 


z 


k 


z 


k 


2 


-0.124(1) 


1.004(2) 


-0.248(2) 


1.08(2) 


3 


-0.50(2) 


1.05(3) 


-1.005(5) 


1.39(2) 


4 


-0.90(2) 


1.08(3) 


-1.80(4) 


1.65(12) 
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TABLE 2 



Fit to kL z for SC and SW. 







SC 


SW 


A 

LI 




7 


k 


7 


k 

IX 


4 


T 


U.O 1 1 i J 




U. OZ, l O 1 


U.OU 14 1 




int 




U.4U I 


n 7^/"^ 


U. VO 14 1 




T X 
' int 


U.OO I X J 


U.OO I 1 1 


n snf9^ 

U.OU I 1 


U.O 1 I O 1 




T M 

int 


U.OO \^/ 




fl 77(91 

U. 1 1 I ^ 1 


U.OO I ^ J 




c E 


U . UO I O J 


J. . U4 1 O 1 


U . UU I 1 
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r x 




n 7fiffi N \ 
u. luyuj 


-u.uo^z j 


i.ui ^oj 




„M 


U.WO I U 1 


U.UJ IOI 


U . U1 1 O 1 


U. jll U 1 




q- 


U. I 1 yZ< J 


U.HIZ 1 


U.Ul ^Z J 


1 OAffti 

l.UI^U J 




T E 

int 


U.UO ^Z J 




n ^&f9^ 

U.OO ^Z J 


1 HQ ^ZL^ 




T X 
' int 


U.UI I Z 1 


fl Alt'?} 


U.OI l Z 1 


j. . J.U y^t j 




T M 
int 




U.tiU I Z J 


n ^f9l 

U. OO I z J 


1 07(A) 

l.U 1 v^v 




c E 


-U.Ul I 1 J 


l.UU ^Z J 


-U.UZ yL j 


1 m (o\ 

1.U1 i^z J 




rX 


n nnf9^ 

-U.UU I Z J 


n 

U.OU 11 J 


Pi Pl^fl 
-U.UO ^ 1 J 








U.Ul I Z 1 


u. / o y^± j 


U . U 1 I Z 1 


1 . UU 11 1 


9 

Z 


1 


n 


n 


0.34(2) 


1.27(3) 




int 


n 


n 


0.33(3) 


1.31(5) 




ex P(^) 


0.47(2) 


1.13(4) 


0.84(2) 


2.21(11) 




ex P(^t) 


0.42(1) 


1.17(2) 


0.75(2) 


2.44(9) 




c E 


-0.00(1) 


0.98(1) 


-0.01(1) 


1.00(2) 




c x 


-0.05(3) 


0.94(9) 


n 


n 




C M 


-0.07(2) 


0.89(5) 


n 


n 




c c 


-0.23(2) 


2.22(8) 
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TABLE 3 



Fit to kL z for LC and WO. 







LC 


WO 


d 




z 


h 


z 


h 


A 


T 

T2 

T E 

int 

int 

T M 

int 

T° 
int 

c E + cf 
c x + c\ 


0.96(12) 
0.8(2) 
1.08(2) 
0.97(2) 
0.97(3) 
0.82(1) 
0.03(2) 
0.06(8) 


0.53(12) 
0.4(2) 
0.36(2) 
0.34(2) 
0.31(2) 
0.56(2) 
0.93(3) 
0.74(12) 


2.08(9) 
2.07(18) 
1.95(3) 
1.80(3) 
1.79(3) 
0.6(2) 
0.00(1) 
-0.07(15) 


0.30(4) 
0.13(4) 
0.31(2) 
0.32(2) 
0.34(2) 

0.6(2) 
1.00(1) 

1.1(2) 


3 


T 

T E 

T E 

int 

T x 

1 int 

'int 

T C 
int 

c E + cf 
c x + c\ 
c E 


n sq/'7^ 
U.oo^ ( ) 

0.8(3) 
0.87(1) 
0.75(1) 
0.76(2) 
0.66(2) 
0.01(1) 
0.2(2) 
0.13(5) 


C\AA (P.\ 
U. 44(^0 ) 

0.23(9) 
0.38(1) 
0.39(1) 
0.36(1) 
0.60(2) 
0.96(2) 
0.5(2) 
0.63(8) 


L.ooyo ) 
1.17(9) 
1.36(1) 
1.22(2) 
1.21(2) 
0.36(3) 
0.00(1) 
-0.10(4) 
0.11(6) 


U.4Z^Z J 

0.25(5) 
0.36(1) 
0.39(1) 
0.41(2) 
0.75(5) 
1.00(1) 
1.17(9) 
0.61(8) 


2 


T 

T C 
' mt 

r E _i_ „E 

c x + c x 

c E 

c x 

c c 

C E 

c\ 


0.46(2) 

n 

0.06(3) 
-0.03(3) 
-0.04(4) 
-0.11(3) 


0.50(3) 

n 

0.73(7) 
0.65(8) 
0.62(8) 
1.19(12) 


n 

u.uy yL j 
0.00(1) 
-0.03(3) 
0.05(4) 
-0.01(9) 
-0.09(9) 
-0.8(2) 
-0.15(10) 
-0.07(7) 


n 

1.00(1) 
0.98(2) 
0.67(8) 
0.54(18) 
0.7(2) 
2.1(5) 
0.35(11) 
0.46(12) 
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